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ABSTRACT 


The relationship between the weighting matrices and the 
design objectives for finite-final-time linear regulator 
systems is considered. An iterative algorithm is presented 
for selecting a weighting matrix that reduces the absolute 
difference between the actual and desired values of a vector 
design measure. The algorithm utilizes the sensitivities of 
the vector design measure to determine changes for the 
weighting matrix. These sensitivities are approximated by 
finite-difference perturbations of the weighting matr 1x 
elements. Examples are presented that illustrate the 


design procedure. 
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Te INDRODUGLLION 


‘The linear regulator is one of the most extensively 
studied and well known problems of optimal control theory, 
W258 aso, pen This importance stems from the fact that 
many practical control problems can be formulated in the 
linear regulator form. Its most desirable feature is that 
the optimal control law employs linear state-variable feed- 


back. 


A. THE GENERAL LINEAR REGULATOR PROBLEM 

A linear regulator problem may be formulated as follows; 
Consider a completely controllable, completely observable 
multivariable time-varying dynamic system 


X(t) = A(t)x(t)+B(t)u(t) (I-1) 


and the performance index 


t 
= (tg) H(t sf Fose(t)TO(t)x(t)+uy(t)R(t)u(t))dt, (1-2) 


where the real symmetric nxn weighting matrices Q(t) and H 

are non-negative definite, and the real symmetric mxm weighting 
Mathix MkKty 1S positive definite. x(t) 1s the nxl state vector, 
tee) ets thie mer esee of controls, B(t) is an nxm matrix, A(t) 


1S an nxn matrix and the final time, is fixed. The optimal 


tes 


* E . 
control u (t) minimizes J, and iS given by C2 


-R-*(t)Bi(t)K(t)x(t), 


{c 
ct 

~~ 
1! 


* 
it 


x 
Saree (we c( € ) \s 


K(t) 1s the nxn positive definite symmetric matrix solution 


to the Riccati equation 
K(t) = -A(t)K(t)-K(t)A(t)-Q(t)+K(t)B(t)R™'(t)B (t)K(t) (1-4) 
with the boundary condition 
BO ea) Je (T-5) 


Because the system 1s assumed to be controllable and 
observable, it is possible to achieve arbitrary dynamics with 
state-variable feedback L7]. The Practical application “oF 
optimal linear regulator theory to system design leads to 
the problem of selecting the weighting matrices. The state 


trajectory of the optimal system given by the solution of 
° re * 
Bet) = A(t )i=B(t P(t xe) (I-6) 


is dependent upon the weighting matrices chosen. It is 
therefore desirable to establish a relationship between the 
weighting matrices and the design objectives (such as percent 
overshoot, time to overshoot and settling time) with the ob- 


jective of developing a design procedure. 


B. A RESTRICTED LINEAR REGULATOR PROBLEM 
This thesis considers only the time-invariant, single- 


input, finite final-time (t,< @) linear regulator problem. 


f 


For this problem A, R, and Q are constant matrices and B is 


the constant nxl vector b. 


CG. “EITERATURE SURVEY 

None of the literature surveyed proposes a systematic 
procedure for finding a suitable weighting matrix Q for the 
finite final-time problem (t, <«)., The infinite final-time 
problem has been considered by several authors [5,7,8]. 

The most extensively used method for selecting a suitable 
weighting matrix Q is to make an educated guess, observe the 
result, and update the guess. The major fault here is that 
there is no guarantee that an acceptable Q can be found in a 
feasible number of trials. 

The most definitive procedure for finding Q in the infi- 
nite final-time problem has been developed by Chen and Shen le. 
In their procedure a weighting matrix is selected to yielda 
set of desired closed-loop eigenvalues. A direct relationship 
between a incremental change in the closed-loop eigenvalues 
and the corresponding change in the weighting matrix Q is 
established using Jacobi's sensitivity formula and perturbation 
of the steady-state solution of the Riccati equations (K = QO). 
Two iterative algorithms are given for the determination of 
the elements of the weighting matrix Q. 

This procedure would be difficult to extend to the finite 
final-time problem because a desired set of time-varying eligen- 
values would have to be formulated. It was felt that this 


extensrton woura not be beneficial . 


A different approach was taken by Wakeland in his doctoral 


dissertation [8$. He considers the System given by 
e = Ae ee") 


where A is an nxn matrix in phase-variable form [9] and e 


is the vector difference between the system output c and the 


desired system output r. The performance criterion used is 
tee) 
oT 
_ -{ Eee (1-8) 
O 
where Q 1s an nxn diagonal matrix. Wakeland's empirical 


results show that the elements of the weighting matrix 


nn 


Q a diag LL don 2dagr +94 \ fal =9:) 


are directly related to the slopes of the elements of the 
cost functional with respect to the parameters of the system 


matrix, where the cost functional is expressed as 


=) 12°) f°) 
Zz 2 Z 
J “J e, at + do f e,dt oe me edt. (Ig 2 OR 


The weighting matrix elements are defined in terms of these 
Slopes for second-,third-and fourth-order systems. Analytic 
relationships between weighting matrix elements and system 
parameters are developed, and graphs and tables that repre- 
sent these relationships for second-,third-and fourth-order 
systems are given. These graphs and tables present the re- 
lationships between weighting matrix elements and certain 
time-response performance characteristics such as overshoot 


and settling time. 
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Schultz and Melsa, iy consider the infinite-time problem 
(t, = ©) where the system is assumed to be in phase-variable 


form and show that the cost functional given by 
fo <] 
t 2 
J # (x (t)Qx(t)+ru(t) )dt ie) 
O 


may be reduced to 


[oe @] 


Jj -{ [oxTx(#))7ee0(4)?| dt+x"(@)Sx(@)-x"(0)Sx(0). (1-12) 


: : : th th 
S 1S an nxn symmetric constant matrix whose n row and n 


columns are set to zero, in order to make the reduction in- 
dependent of the system (A,b). Since the tern, x" (0)Sx(0), 
depemds—eoOnly son the imitial conditions, x(0), it has ne 

effect in the minimization of J. For the term, x (#)Sx(#), 

to have no effect, the system must be asymptotically stable. 

The reduced performance index has only n weighting factors 

to be considered which can be related to the concept of 
modeling,L5]. The elements of the weighting vector, Y, form 


the coefficients of an (n-1l)st-order differential equation 


aie) 


vtec ety ot = (0 (oieert 3 } 


1 3 


which must be satisfied by the output of the system under 
consideration to minimize J. Therefore, equation (I-13) 1s 
regarded as a model for which a desired response is formulated; 
the model is adjusted to satisfy classical response charac- 
teristics, such as rise-time, overshoot, phase margin, and so 
forth. The adjusted coefficient vector, Y, is the weighting 
vector for the performance index. 


li 


II. FORMULATION OF THE WEIGHTING-MATRIX SELECTION PROBLEM 


A. INTRODUCTION 

The basic system considered is a controllable, observable, 
multivariable, time-invariant, single-input, linear dynamic 
system given by 


S(t ee Ax( st) aoe lary) (II-1) 


The performance index to be minimized is given by 
t 


iff 
y=%f (xT tyox(t)+ u(t) Vat, (11-2) 
O 


The optimal control that minimizes equation (II-2) is given 
by 


ie T 
u(t) = - BK(t)x(t)- it lay) 
K(t) is the solution to the reduced Riccati equation 
. T a 
K(t) = - A K(t)-K(t)A-QtK(t)bb K(t), (11-4) 
which has the boundary condition 


K(t_) = ©. (II-5). 


B. TRANSFORMATION TO CANONICAL FORMS 

It was decided, from a computational standpoint, that the 
number of non-zero elements of the Q matrix should be small. 
For this reason, transformation of the system to two canonical 
forms was examined; the diagonal state-matrix form and the 


phase-variable form. 


2 


A system that has no multiple eigenvalues may be readily 
transformed into one that has a diagonal A matrix by the 
following procedure. The system has a column-partioned matrix 


of elgenvectors given by 
B = 55 paety igi) 


where each elgenvector e. 1s associated with its eigenvalue 


A. This matrix may be normalized to 
Si 


aA [AA A 
E = 2,25°°-e (II-7) 


by normalizing the individual eigenvectors to unit magnitude. 


A 
By letting x(t) = Ez(t), the new system is given by 


z(t) = A,z(t)+b, u(t), (1-8) 
where 
a 
A, = E “AE (II-9) 
and 
A-1 
ee ee (II-10) 


The atr1x< A. Tas the form 


1 

O , O 
ry O 
Opie Aaa) 

a 
O O AW 

Ss 
Ay ae ® ° ° (II-11) 
O : O A 
n 


AES) 


With the system in this form, a diagonal Q matrix may be used 


and still have complete influence on feedback; but the elements 


of the matrix A, may be conjugate complex. This requires that 


di 


all computation be done using complex arithmetic. 


Since the system under consideration is completely con- 


trollable, it can be transformed into the phase-variable form 


with a linear non-singular transformation matrix T, by letting 


x = Tz as in Rane {9}. This leads to the phase-variable system 
z= Az + bou (I1I-12) 


where the system matrix has the form 


O O P O 
O O 
O O O 1 
Ane (II-13) 
O O O 
OF O 1 
7 Sy eae: wa 
and be = Poo. aeons The elements in the last row of Ao 
(a;, i = 1,...,n) are the coefficients of the characteristae 


polynomial for the original system matrix A. This polynomial 


is given by 


n n-L n-2 
S ta S +a Ss ag se. eaette +a 
n 


The transformation matrix T iS given by 


7 = eens 5 
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(11-14) 


(II-15) 


where the element vectors may be formed by the recursive 


relations 


t =b 
= me 
t Sey te tba 
Sel Eek) atte) 
= + 
wae Le | 
: (II-16) 
= +t a 


2 Sy, ; 
C. DIAGONALIZATION OF THE Q MATRIX 

Kriendler, oe states and proves the following theorem. 
If a linear time-invariant plant is in the phase-variable 
form, then for any positive semidefinite matrix Q in the 


quadratic performance index 


fo =] 


is J (x Oxtu") dt, (I-17) 
O 


there exists a unique diagonal matrix 


” = diagl a : i ite 
Q oe 1aq Sai? SoD ie ad ,n-1 Aen ( z ) 


which yields the same optimal control 


u(t) = = biK(t)x(t) (II-19) 


and is related to Q by the formula 


fa. = “G26. eae eles Sy ghee a ver ae -20 
Wi 44 erect pean — ) 


where the alternating sum is continued until all of the avail- 
able q's are exhausted. Even though. Q is required to—he _ 

¥ 
positive semidefinite, Q needed not be so restricted. Let 


Q be the positive definite matrix 


1 


UGE 
Q =") cea ao CLS) 
yey 
Then 
% e 
Q = diag L10,-3,1] (1 r=22)) 


~ 
where Q is unique. 
% 

It should be noted from equation(II-20) that Q does not 
depend on the elements Sls of Q where it+j iS an odd number. 
Therefore when the system is in the phase-variable form, an 

: : 1 : 
equivalent matrix Q > (simpler than Q) may be considered, 
where : = if i+j is even and : = 0 if Mis 1278 0dd 

q ij qj J q ij J ; 
The matrix gt retains the positive definiteness or semi- 
definiteness of Q. 
The optimal feedback control law, p, defined by 
4 JT 

B= Daas (Tis2ey 
; : : . : 136) 
1s a time-varying row vector consisting of the n column 
of the Riccati solution, K, for a plant in phase-variable 
form. For the infinite-time problem, the diagonal weighting 

% 

matrix Q is unique and yields the same feedback p as that 
corresponding to the original matrix Q, where 

ay Le 


p = DK. = bec (I1-24) 


c —_—-_— @® 


D. INITIAL CONDITION CONSIDERATIONS 
Designing a system for a specific initial condition does 
not necessarily produce the desired time response for other 


initial conditions. A conServative design approach is adopted 


eG 


here by assuming that worst-case initial conditions occur. 
Worst-case initial conditions are defined as those which 


maximize the minimum value of the performance index as given 


by 
T 
= O O Or) - 
Jnin =X (0)K(0)%(0) (11-25) 
Seer is maximized when x(O) is collinear with the eigenvector 


associated with the largest eigenvalue of rato) nine 


My. 


IIT. PROBLEM SOLUTION 


A. SEARCH IN (O SFACE 

The most direct approach to selecting the weighting 
matrix, Q, would be to perform an exhaustive search, evalu- 
Beeb the state trajectory for each of Several selections 
of Q. Even for a low-order system, this is a formidable 
task. 

A more reasonable approach is to make an estimate for Q, 
evaluate the state trajectory and then change Q based on the 
closeness of the state trajectory to the design objectives. 
This procedure is continued until the state trajectory is 
acceptable. As this requires a subjective decision, time- 


shared computer operation is a necessity. 


Bs  STATE-TRAJECTORY SENSITIVITY 


The sensitivity of the state trajectory with respect to 


Ox e e e ° e 
o, » can be evaluated by using the sensitivity function 
approach. This involves solving the Riccati equation 


Roe A K-KA+Kbb K-Q (III-1) 
with the boundary condition 


ne) Se (III-2) 


simultaneously with its associated sensitivity equation 


d_/{ 9K T AK By clSe Pees C) Se) J 
2. (38), Tse " S00 aes! "kK + Kbb! Yo) 
with the boundary condition 
dK(t_) 
aon = (II1I-4) 
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Then the state equation 


x Sm AXeechegiaia x(O) = x (III-5) 


must be solved simultaneously with its associated sensitivity 


function equation 





df dx(t)\ | Te Oe T OK 
dt ( 30 ) = (ArBR K) SQ * PP “age (aes) 
with the boundary condition 
8(x(9)) 
—\ ae O. (III~-7) 


For an Pero e « system, Equation ITI-5 contains n firste- 
order differential equations. Equation III-l contains n* 
first-order differential equations of which eee are 
unique since Q, K, and K are symmetric matrices. Equations 
TII-3 and III-6 contain (a-tnst))? and 5 le unique 
first-order differential equations, respectively. Table I 
demonstrates the rapidity with which the computational com- 


plexity increases. 


Gaple 1, Thegnumber ofedifferential cquwtions, N, 
that must be solved for a system of order 
n to evaluate the state-trajectory 
sensitivity, dx/dQ 


n N 
; I 
2 20 
3 63 
Ly 154 
5 320 
LO 11025 


ox 


The state-trajectory sensitivity matrix, 50” must be 
observed over the entire trajectory to obtain a relationship 
between it, the state trajectory and a new weighting matrix. 
A subjective decision in the selection of a new Q is required 
Since there does not exist a direct analytical relationship 
between the design objectives for a finite final-time problem 


and the weighting matrix Q. 


C. THE DESIGN MEASURE m 
1. Definition 
The approach that seemed most promising required the 
formulation of a vector design measure, 


ila £(Q;x ,t). (I1I-8) 


Typical examples of the elements of m are listed below 


2\2 Max] u(t) | OS tSst 
6 


f 


b. Percent overshoot 

c. Time to maximum overshoot 

G) Time to first Zero crossing 

e. Time to reach and remain within 5 percent of the 


final ovaLuc 





f Pater) 
ue 
g. ( Fu(t)-dt 
O 
ve sea a opin she Oxi, 7 _ 
h aA a a , where > a 1s the state- 
O 


trajectory sensitivity to variation in system parameters, a, 


and s is a symmetric positive definite matrix. 


iheteherames Ossie nemmun ther restricted to be defined 
so that they will be positive. (It should be noted that an 
analytical expression for the partial differential of the 
elements Of Gm With=resmect ™o the elements of O%does net 
generally exist.) 


The desired vector design measure was defined to be 


¥% 


m ; the vector, £, has the elements defined by 
Ze i | = eee 9) 
a || een. - eee gL lite 
j 4-5 J 925 ( 
where L 1S a positive integer. The elements of f are to be 


made acceptable by adjusting the weighting matrix Q. 


2. Difference Approximation to the Sensitivity Matrix om/dQ 


m 
The sensitivity matrix, 30 can be approximated by 


perturbing the weighting matrix elements qi; to form a finite- 


difference approximation to the partials, omrcorne 52S 


VeetoOrNdittherential dmeis given: by 








= “oe O 
CH Saale, (1S: (III-10) 
om 
where 30 has the form 
Om, on, om, 
04, %9)) 6444 
om, om, 
9455 94a 
Om (aerate LT ) 
== 
dm, ém., Om, 
3 nn 0qon 99 an 


BM 


and dm and dQ are both column vectors, with dimensions (Lx1) 
and (mxl) respectively. Equation (III-10) is used to select 
a dQ that will reduce as many of the elements of the design- 
measure difference vector, f, ast possible: 
3. Computational Algorithm for Selecting Q 

The steps of the basic algorithm for finding the "best" 
weighting matrix are outlined in Flow-Chart 1, with details 
given by the following list. 

a. Transformation of the system into the phase- 
variable form, in order to use a diagonal weighting matrix Q. 

b. Selection of an»initizal diagonal weighting matrme 

Go. Fhormationsof the des igneameasute om gay 

(Ll) »Integrating the Riccati equation 


(2) Finding the worst-case initial conditions 


(3) Integrating the state equations with K(t) 


- 


and x(0). 


% 
(4) "Setting m = SGQpaac t 


ar 
d. If m is not defined or is unreasonable, a restart 
is made at step b; m is not defined if some element does not 


exist. For example, if the optimal system is overdamped, 


percent overshoot has no meaning. 


e. Formation of the design-measure sensitivity matrix 
ou lone: 
dQ 
(1) Perturbing the Q elements, q,,°151,2,...,n. 


Ze 


° SP ' 
(2) wintegmettamgr the n sets of ( gute.) Riccati 
aL . ‘csp saaeeey 
equations, K , with Q = diagonal (994 °do0°-+ +93, 449 . ee rae) 
for Gi—ob,2,... ae 
Bneegratving the n state equations uSimg K (t}. 
3 grating th quati ing K™ 


(4) Forming the perturbed vector performance 





ae 
Heasmmes, m , ¢ = Ly... 02 yn. 
ome eri. 
Cy Lee 
ee) aq a q tae 1,2, nn; Jzil,y2, »L 
a1 il 
dm 
£. Selectiren of a™normal ized GOiaaus ing a 50’ that 
e. This 


will improve as many of the elements uve as possibl 
procedure is discussed in more detail in section III C4. 
g. Selection of the magnitude, @, for dQ and 
evaluation of m' lore 
Cl Pp @bnitializing & 
(2) Setting Q= Q + MIdQ where I is the nxn 
identity matrix. 
(3) Forming the vector performance measure m 
for this value of Q' bys 
(a) Integrating the Riccati equation's 
using ar. 
(b) Finding the worst-case initial con- 
ditions x'(0) for K'(0). 
(c) Integrating the state equation's with 
hao) and kK (4). 


1 


WW sSettingem’ = £19 3x styt,) 
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h. Formulation of subjective decisions based on 


& 
i. = nm. 7m, | I = “See . ee Crrr=i25 
and 
: Sat ¥ : 
dai Dag Leen eameeleacamnatecl” Clit 13) 


(1) £ is considered to be an improvement on f 
if any of the following conditions exists: 


(2) eis 2. die ae 


(b) The number of values of 1 for which 
i S ft. is greater than L/» 

(2%) fem is considered to be acceptable at this 
step if any of the following conditions exist: 

(a) fi, s ce for a majority of the elements 
ae where a is a positive small number; 1 =Sj25e8 25L- 

(b) @ S €p; where €p is a small positive number. 

() Fa 1s considered to be acceptable for the 
design if any of the following conditions exist: 

(a) fie = C. for a majority of the elements 
of sa where c. 1s a small positive number (€% < e#) and it is 
clear that no further significant improvement can be made in 
the other elements by moving locally. 


(b) @ 5S € where EF 1s a small positive 


§ 
P 
number and the inequality a. << os holds. 
(4) (a) If h. (1) is true, increase @ and go 
im Step gi. (2). 
(b) If h.(1) is not true, decrease @ and 
go to step g.(2). 


(c) If h.(2) is "true, go to step ", > wire 
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Flow-Chart l. 





Basic Steps of One Iteration of Design Algorithm 





Select Initial Diagonal 
Weighting Matrix Q 






ev) 


Form Design-Measure m 


Form Design-Measure 
Sensitivity omgQ 


Select A Normalized dQ That 
Causes 


Form Design Measure m- 
From On = Q+AT dQ 





Acceptable Design If 
it, penetra qeeaet ais 
1 1 Z 
or 


aaa aaa 


P 
or 


3. No Significant Improvement 
Can Be Made Locally 





Acceptable NotwAcceptable 


G 4) 
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2m Ro) | ©) ok. 6 an ae ae 


continued 


Test for Global Improvement 
By Selecting New Initial Q 


nm’ Acceptable For This 
Iterationmgaif 


LO = 
Pp 


Or 
a ie < a Rome caste 











Is An Improvement On 
Le 


ls {3 





t 
ts 3 f. For At Least = 





Increase 
OL 


@ 
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1. Testing the weighting matrix found by perturbing 


t 
Q to determine if a significant reduction can be made on the 


elements One se If a significant improvement can be made go 


t 


to step e, with Q=Q 





4. Considerations for Selecting dQ 
a. Problem Formulation 
om. 
The vectors, yaa jee 2h, are normalized 


to the vectors ian by 


(III-14) 





There exist L hyperplanes ne defined by 


’ \ 
H.://w.,dQ\= O ae ee eee III-15 
5 (C5-29)} J ’ ’ ( ) 


where (. , . ) denotes the inner product in n-dimensional 
Euclidian space, Dae w is in the direction of the largest 
Tate of Qmerease of a. Therefore the best @Q to select 
for a particular ome 1s colinear with ig The sign 
selected must be that which causes ue to minimize £ =|m,-m.|. 
For L > 1, a systematic procedure must be established to 
select a dQ that will minimize as many f.'s as possible. 

The unit normals, a je— 132 ,.eeee, thateresult 


in a reduction of fe are given by 


% 
Ww. m. =m 
= J a; 
=j = % J = 1,2,...,L. (III-16) 
-W. m.- m 
J ay a) 
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Defining y = 6Q, there exist L half-spaces es where S. 
a a) 


is the set of all~yothat Satisty thesrelat ren 
agp 2 2 0 a ieee ee reece y ox GirT=17") 


Thus the hyperplane is and its normal ae define a half-space 
S. which is the set of all points that reduce eh 


The intersection of all the So given by 
1G 


oe Si» (III-18) 
aul 


defines the set of all points that reduce all ae Simultaneously, 


provided that S is not the set, ~, which contains only the 
origin. If S =, some of see must be allowed to increase 
so that a partial improvement can be made at this step. This 
relaxation should be made only for one iteration. 
b. General Problem Considerations 

(1) First-Order System. All normals oie forge 
first-order system, must be of equal Sign to improve all 
components locally. If this is not the case, the selection 
of dQ becomes subjective for a particular trial point. 

(2) Second-Order System. A second-order system 
is considered next with L < 2. Since all the normals, Be: 
have been normalized to be unit vectors, the inner products 


Ri ~ (225) - i, j = 1,2; =a (IIT=1ey 


indicate the nature of the sets, SH ae given by 


See =) Sse. (III-20) 
a 1 J 
a = 1.0 implies that n. scene are parallel, therefore 
S.4 = 5S, = oe (III-21) 
15 1 J 


as indicated in Figure l. 
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Figure 1. Intersection of 2 half-spaces in 


2-space. Rag el 
ae = - 1.0 implies that n. os. are anti-parallel; there- 
fore 
Sie = WH ee. (III-22) 
1j 1 j 


as indicated in Figure 2. 





Figure 2. Intersection of 2 half-spaces in 
2=-Space. R.. = -l. 
1) 
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1eag se 7 + 1.0 then there exists a region, Ro» where both 
inner products <n jd) and Chg yi are greater than zero, as 


required to reduce the design-measure difference elements 


f. and ae Simultaneously. This is depicted in Figure 3. 





Figure 3. Intersection of 2 half-spaces. See 7 ele 
Suppose that L = 3 for a second-order system. 


are linearly independent anda 


If Rio aac then ny and n, 


can be expressed as a linear combination of ny and n, by the 


relationship 


re (111-23) 
where N is the partitioned matrix given by 
= t - 
N ES 22| (111-24) 
| 


and a is a column vector with components Ay» ay. 
For example, Figures 4 thru 11 depict the 


relationships that can exist between half-spaces S}9S5 and 3 
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for various combinations Of ay and a,. In Figure 4, S, 


contains the intersection of S) and §S therefore S.. may be 


23 
dropped from consideration. 
h 
Re 
43 
ZR on 
[A y, 
“a 
a ao / Ha 
/ H3 
H, 


Figure 4. Intersection relationships for aro, a,70. 


The same situation holds in Figures 5 and 6, where Sy and Sy» 


respectively, may be dropped from consideration. 


Ni 


Y, 
a n 
— tg 
ae A\ 2 Ha, 
2 / 
/ As 


i H, 


Figure 5. Intersection relationships for a,70, a_<0O. 


1 Zz 


oul 


ng)” 


R3 i , 
LV" 


Ee / Me 
ji H, 


Figure 6. Intersection relationships for a,<o, a,70. 


In Figure 7, S. = a and in Figure 8, S, = S5; theretore S3 


may be dropped from consideration in both cases. 





Figure 7. Intersection relationships for a,=l, a,=0. 


1 2 





=O, a,=l. 


Figure 8. Intersection relationships for a , 


1 
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Inerkiaures 95910 andell, S,AS,9S., = 0; therefore at least 


one S. must be dropped from consideration to have a non-zero 
1 


dg. 





Figure 9. Intersection relationships for a,al-, a, =o. 





Figure 10. [Intersection relationships for a 


a,=-1 e 


eS ee 
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R3 
hi 
fo 
= 
H 
i / = 
Ry 
Rs | ns 
H 
/ i 
Figure ll. Intersection relationships for a,<0, a,<0. 


$9 $54 S, — 10h 


The general results related to these figures are tabulated in 


Table II. 
Figure ay a, Relationship Drop From 
Consideration 
Ly >0 20 $2.5, S, S S. 
5 >0 <0 Sj25,S, $4 
6 <O 0 $,25,/ S. S, 
7, >O =0 S, =S) S. 
8 =0 ?0 S.5 =S., S2 
9 <O =O S 1% $3= =H, =H; S) NS 2! S3= ~ S, or S. 
10 =0 <O $9 Ss, S3= 93S, S.-H, =H, S, oF S. 
11 Ono $s, 9 si S3= p S, or S, or S. 


Table II. General relationships for sets BoE 


j = 1,2,3 for a second-order system 


when (22) y+. 
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As an example, if Table II has indicated 


that S. should be dropped from consideration, the normals 


may be used to form a vector, dQ’, that lies in the 


=1’=2 
region Ry given by the angle a, in Figures 12 and 13. aQ' 
is defined by 
ag' = [2 | c (111-25) 
where c is a column vector with components C1 9Co- If cy and 


Cc, are restricted to be positive, then dQ’ lies in the region 


t 


i . ® = = oO ea 
Ry which 1S contained by Ry if (795) O, as in Figure 12. 
t . ° < . ° t 
Ry contains Re if 25H) O, as in Figure 13. For dQ to 


the angles 9 and 9, must both be 


lie within the region R ? 5 


| ls 
less than or equal to 90 degrees. Let 


t 


i.2) 


dQ = See COC 
\ (dat)? +493)” 


Then the restrictions on 9. and 8. become 


1 2 
(2100) 
and , (III-27) 


Cae 


(III-26) 


t 


Figure 12. Region relationships for Gr) 2 0. 


aD 


Figure 13. Region relationships for en <0) 


The procedure discussed above considers only 
three Det SD: 3} = 1,2,3, at a time, but can be extended 
to the case where L > 3 in an iterative fashion. At each 
iteration, one. 1s dropped from consideration using Table (II). 
This process is continued until oe ee have been considered. 
(3) Third-Order Systems. For a third-order system, 
Similar reasoning is used to develop a basis of three linearly 


endependen aaa A fourth normal ny, can be represented by 


ny, = 4,9, + ann, + aan, (III-28) 
ee ee (III-29) 
=e (III =36 
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3 


can be dropped from 


Ifealf’ a. 2°0,4fhen SS ff) SS. ands 
j se 4 
consideration. If all a OF =. = 9 and one of the 
2 a 


four das must be dropped from consideration. Table III 
gives the appropriate relationships for n = 3, L = 4, where 


any 3 of the shots ae are linearly independent. 


a, a, a. Relationship Drop From Consideration 
20 20 20 S> SAS_NS S 
me eS 4 
<O <O <O x S.= 9 Sssor.S.0em S.sotys 
— 3 iL 2 3 4 
1 
—" > 
O Oo 20 $328,188, S. 
=O <O <O 4 a S. or §S or S 
Weg * 2 3 L, 
y= 
> 1 
O 0) <O Sj 25,8, Sy, Sy 


>0O 20 < 1 
O $9 S48. ie 


intersected by §S 
in such a way as 
co Loria fetrth 
bounding hyperplane. 


Table III. General relationships for sets S., 
j = 1,..,4 for a thizds@eder system 
Widen no sn, and yn are LTineariy 
independent. 3 


The relationships that exist for ay > oO, 


a, en) and a. < 0 in Table III imply that many boundary 
hyperplanes could exist for systems of order higher than 


two when the number of hyperplanes, L, is greater than the 


7 


order of the system under consideration. Results from linear 
algebra L10] can be used to show that there may be L-(nt1). 
bounding hyperplanes and therefore L-(n+l) normals to con- 
Sider. For this reason, the algebraic development was not 
pursued further for cases where L 2 ntl. 

The set of hyperplanes not excluded from 
consideration form a convex polyhedral cone in n-dimensional 
Euclidean space. Unit vectors, u., defined as being colinear 
with the extreme edges of this cone, when summed with positive 
weighting, form an interior vector of the cone. These unit 


vectors, u., can be found using linear programming techni- 


ques ania 
The problem may be reformulated into the 
Simplex format as follows. The linear function 
n 
Ze Tee We (LLL = 3a) 


1s to be maximized subject to the constraints 








Ca ae O }) = 18a. -5L (III-32) 
ae 
ye Si i= 1,2, 37 (ILI=3a5 
n 
ye II I-34 
1 =aae:+ \ 
where B is a positive number. If Z can be maximized by the 


Simplex routine, Z will be equal to B, and there may be more 
than one selutien, ye Tf there is no solution, one of the Ween] 
straints in équation (I1I1-32) must be relaxed. If there are multiple 


solutions, each solution, es forms a vector which is colinear 
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with an extreme edge of the polyhedral cone formed by the set 
L 

S= fn 5S. CLTI-35) 
j 


(See Figure 14.) 





Figure 14. Intersection ot 3 hyperplanes in 3-space. 


The Simplex approach requires from one to 
L - n applications of the Simplex routine. It was felt that 
the computation required was too complex and time-consuming 
to allow the overall algorithm to be a feasible design tool. 

If L is restricted to be less than or equal 
to n + 1, the algebraic procedures considered previously may 
be applied to find the normals of the boundary hyperplanes. 
For ease of computation and to make the algorithm feasible, 


L was further restricted to be less than four. 
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c. Problem Considerations for = sneer 


If the partitioned matrix 


N= io ee (III-36) 


is considered, the rank of N, r(N), gives the number of 
independent normals. If r(N) = L then all normals are 


independent. The vector dQ’ given by 


dg’ = Ne ( III-37) 


1s 
So 2 ee Sp (III-38) 
j= 


if the elements of c are non-negative. If r(N) < L then the 
L-r(N) half-spaces eae associated with the linearly dependent 


normals removed from N (for this step only) to give the re- 


duced matrix N’. Then dq’ 1s given by 
dg’ = N'c (ITI-39) 


where c is now an (r(N)xl1) row vector with positive equal 
elements. 
Table II gives the general relationships that 

: th 
exist for an n -order system when L = 3 and r(N) = 2. 

faa. ; : : ; th 
Similar relationships are given in Table IV for an n- -order 
system with L = 3 and r(N) = 1. Table V gives the relationships 


: th : 
that exist for an n -order system with L = 2 and r(N) = l. 


LO 





70 


>0 


<O 


<O 


>O 


<O 


>0 


<O 


Table IV. General relationships for sets Si: S:. 


J 
and S\. ieee = 2, L = 3 and r(N) = l. 


Sq Sasi Fy SFG 
Relationship Drop From Consideration 
i = = = Si none 
eapanoe noe = SE ei Sha Or S. and Si. 
Sh Ou. iS Hi 54k S.> Or S, and S; 
Seo Si = ae Seemior =. and Si. 


Table V. General relationships for sets S; and am 


70 


<O 


where n 2 2, L = 2, r(N) = 1. TF = an 


Relationship Drop From Consideration 
Seles «Sis none 

1 2 
Si, SSE) ena ciency rch ens 

ut J - J z z 


The vector dQ’ found by Equations III-37 or 


III-39, when normalized to unit length gives the dQ required 


in step f. 


matrix Q. 


of the algorithm for selecting a new weighting 
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IV. EXAMPLES 


A. A SECOND-ORDER EXAMPLE 
The second-order system selected for consideration is 


given in phase-variable form by 


0.0 13 O 
a(t )e = et ) ae u(t). (av- 1 
-20. -5.0 1 
The £1na time; tye was arbitrarily set at 2.5 seconds. The 


design measure, m, selected for examination, had the following 


elements: 


m, - percent overshoot for x(t) 
m, - time to maximum overshoot for x1 (t) 
Sd max rye ih Os ts ty 


which had the desired values 






e 5 ae % 
m = 02925 seconds 
0.0 (IvV-2) 
Percent overshoot is defined by 
overshoot of x,(t) 
ms = x100. (IV-3) 
1. Estimation Procedure 


The first method used to select a suitable weighting 
matrix Q was to guess an initial Q, solve for the design 
measure m and then make a new estimate for Q based on mn. This 
of necessity, was accomplished on-line with the IBM 360-67 


computer in a time-sharing mode. 


1,2 


The estimation procedure used is given in the 


following steps. 


a. Guessing Q* 
b. Evaluating m 
c. Repeating steps a. and b. until one element of 


% 
m, Oar was close to ee 


* 


: L+ 2 
d. Selecting on : so that Je remained close to m. 


Is ou 


and improvement was made on one of the other elements of 
This was accomplished by 
1 
(1) Perturbing Q 
; al 
(2) Evaluating @ 
(3) Repeating steps (1) and (2) until a direction 
of change was established that improved one of the other 
« e * 
elements of m while keeping m. close to m.- 
(4) Changing Q as far as possible in the 
direction determined above. 
e. Step d. was repeated until all of the elements of 
mewcre as close as possibWe te their asseciates elements mn 
This procedure changes Q along a contour of Mm. in the 
9117492 plane. 
Using this procedure led to the weighting matrix 
Q = diag [85.6, 13.6], with a computation time estimated at 
25 mintites. 
2. Exhaustive Search 
The exhaustive search for the second-order example 


was arbitrarily restricted to the region R defined by 
oF— = Loor 
R: a1" CiveGy) 
= ° {V- 
s s 
O Goo 20). 
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R was divided into grid points with intervals of dq, 72-9 

and dq, 570.25; dq, was required to be this small by the 

low sensitivity of mM and m, with respect to 1° This 

low sensitivity can be seen in Figures 15 and 16. Approxi- 

mately 100 minutes of IBM 360-70 computation time was re- 

quired to complete the evaluation of m sa twa iggogeddepied n te - 
Figures 15, 16 and 17, obtained from this search, 


give contours for selected values of m m, andm_. Figure 18 


ee 3 
is a composite of these figures. Graphical construction 
indicates that the desired weighting matrices is in a neigh- 
borhood of Q = diag (81.0, 12.8]. 
3. Application of Design Algorithm to Select Q 

The algorithm given in Chapter III was applied with 
all three elements of m being considered in the selection 
procedure for dQ, for three initial Gis TWO initial Q's 
were selected to test the algorithm with only Mm and m. being 
considered in the selection procedure wior dO m@ihe results o# 
these, trials are given in Table VI. 

Attempts were made to test the algorithm with only 
m, and m, or Mm, and m. being considered in the selection 
proce@ure for .dO.seaThe moves made bygthesalcorithm did not 
tend to improve the element not being considered, or approach 
a best Q for all three elements of m. This is partially sduc 


to the insensitivity of m with respect to Q. This insensi- 


De 
tivity was exaggerated by the non-continuous nature of time 


in the digital computer calculations. 
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Figures 19, 20 and 21 show the initial iteration 
moves made by the algorithm for trials 1, 2 and 4 in the 
9117952 plane. ror @ife initial points tested, the largest 
number of iterations required to move Q* (the superscript 
i refers to the latest iteration number) to close proximity 
to the best Q was eight. (No claim as to the uniqueness of 
a best Q is made for this algorithm as this depends on the 

ee | O : 
system, initial Q , and design measure being considered. ) 
From the point, a, which is in close proximity to the best 
Q, at least 20 and not more than 30 iterations were necessary 
to arrive at a locally unimprovable weighting matrix, denoted 

f i 
by Q . The Q *s thus found were not equal, although all de- 
Sign measure elements were considered to be satisfactory. 
whe largest varjdatien beang in Wy to which all elements of 


m are relatively insensitive in this region. 


Table VI. Results for Second-Order Example 


imm.'s Lnweial Final Final 

€onsi Gemed Q Q m 

to select 

dQ 1 aa Dee | alee 2 1. 2 3 
B m, »m,,m., ey) IO? }tom gy 2.897 | 5.0057 0.945 2.075 
3 msm, ,m., 1.0 TOPO NeeetG 12.864; 5.016 02025 2.062 
3 msm, ,m. Oe .C 130s cOm te Im .683 | 5.06 079025. 2.004 
2 mm, O20 10m 7am 12.916 | 5,000) 07925 2.076 
2 m,>m., LOO.0 fOr) Simao? .9141-4 9909 02925 2.0226 
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B. A THIRD-ORDER EXAMPLE 
The third-order system considered was taken from Dal. 


It 1s for the linearized incremental longitudiual motion of 


an aircraft. The system is given by 
-0.0016 1i@ - .0OO2 
Scat) = |-O. t500 Ss ameewl>  -.114r | x(t) 
Ore 0.0 - .666 
0. 
+ | 0.0 nie (IV-5) 
0.666 


The final-time, t was arbitrarily set at 2.5 seconds. The 


i; 


design measure, m, selected for examination, had the following 


elements: 
m, 7 percent overshoot for x, (t) 
m, - time to maximum overshoot for x,(t) 
= Os s 
m. max peleh | t ty 


iG 
which were assigned the desired value 


Yo 


. [as 
PO wise : (IV-6) 
20) 


m = |]0 
O 


The system was transformed to the phase-variable form in 


the manner of |5]. The transformation matrix 
-41.329 -0 .08026 Oo. © - 
T = = 3.40561 om . 320 ie 536 ho (IV-7) 
52.809 eee1O6 On 7 alga 
results ina system matrix given by 
O'; i, oe 
Ag = om Oo is (IvV-8) 
= Seis -8.88 -6.8 


aS) 


Therefore the system is given by 
O 
ACEI ACE) apne Ge (IV-9) 
il 
The design measure, m, is defined with respect to the 
original states. Since it was desired to observe the state 
trajectories for both the phase-variable form and for the 
original states, the computer program was written to trans- 
form the phase state Z(t) to x(t) at cachwmntegration step, 
in order to evaluate m. A more direct method is to trans- 
form the diagonal weighting matrix to the general forn, Q, 
and perform all integration in the original state form. 
Q, 1s given by 


Qo = (tot yfa(r ty. (IV-10) 


Kriendler's [4] selection for the Original system 
weighting matrix is Q, = diag (ero OF CRS e ORO avasye e 
led to the design measure 


4.497 
m ={ 1.1 (Iv-11) 
97.2 


No attempt was made to guess the best Q, or to use the 
exhaustive search method, as it was felt the expected results 
would not have been worth the time or effort involved. 

The algorithm given in Chapter III was applied to the 
third-order example, with one, two and three design-measure 
elements, ee being considered in the selection procedure for 
dagQ. The results of this application, with test points, are 


tabulated for all trialsein table. 
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Favorable results on any one trial depended on the initial 
: é O =. 
weighting matrix, Q , selected and on the elements oe being 
considered. The first trials (1-8 in Table VII) were made 


considering either all three elements, ° or elements m, 


eae. ; fe % 
and m,,- Most initial points resulted in an ms close to Mm, 


* 
but ms could not be reduced to ue mn. was at an apparent 


local minimum in Q space. Those trials that considered all 
design measure elements in the selection of dQ tended to 
reduce m. more rapidly in the local region. 

Since ms; seemed to be least changeable for these first 


: ‘ O ; ie 
trials, a starting Q was selected that had resulted in m 


* 
close to m,- A trial (9) was then made considering only m., 


mor seleestiwg dQ.) Tre result wag a Significant reduction in 


%* 
m,-m, did not increase unreasonably. Sub- 


% 
mo-m,| while l 











sequent trials alternated between considering m., and con- 


Sidering both m, and m, in the selection procedure for dQ, 














il 2 
: : ifs = 9 
with a resulting Q that reduced both m,-m, and m,-m., 
to an acceptable level. The Q thus found was used as the 


re oO ., , 
imitial’® ima triah (14) where all three elements ae were 


considered in the selection procedure for dQ. This trial (14) 














¥ ¥ 
Significantly reduced both m,-m, and m,-m., in two 
iterations. Tests in the neighborhood of the Q found in 


tr ial (14) showed that the element, Wase zero for this 


aoe 


System. 
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The best Q found, using the algorithm, transforms to the 


Original system form, Q , given by 
29 .87207 FOr 76 Ri oi 107° 
Q. = 1) e276 6.54338 22/05 x 107” (IV-12) 
-1.393 x 107° 299705 x 107” 6.497 x 10724 


which is positive definite. 


C. DEMONSTRATION EXAMPLE 


A second-order example, that had not been considered 


previously, was selected for a comparison of the trial-and- 


error estimation procedure and the design algorithm. This 


system is given by 


=| 90 king Coy + | 57g | Cee. (IV-13) 


The final-time was arbitrarily set at 2.5 seconds. The design 


measure, m, considered had the following elements: 


m) - percent overshoot for x(t) 
m, - time to maximum overshoot for x_(t) 
m, - max {u(t Os ts t 


which had the desired value 


40 % 
,925. "See. (IV-14) 
le, 


a 
i 
@ Cig 


The estimation procedure was applied for several starting 


% % 
1 and M,, « 


Oo = diag [ 500.0, 0.0] was the most satisfactory POL: £oune, 


points, with no success in satisfying both m 


the design measure for this Q was nm =WIAMO2O), 2925.6 21.071), 


CPU time was seven minutes. 


5) 


The design algorithm was applied for an initial 
Q = diag 1100.0, 0.1], with only m, and m, being considered 
in the selection of dQ. After five iterations, an unimprovable 
weighting matrix, Q = diag L100.56, 0.153995 was obtained, 
which had the design measure, m* = (5.026, 1.4.0-59)]. with 
only Mm, and m, being considered in’ the*scmee mie at Scan 
initial Q = diag [500., 0.1] resulted in Q = diag [499.9998, 
=a and m? = .. 5 @O22. 0.925, 21.966] in one ae 
Considering all three elements of m Ungihe scleoae tage do, 
an initial Q = diag [ 500., -1.125] resulted in = diag coe 
eo GS. | and m- = L 5.0008, O25 21.955] in Six Itetrati once 
Five minutes of CPU time were required to perform these cal- 
culations. 

Application of the algorithm, considering one, two or. 
three elements of ming the seleetiopsof dQ, .for @hic, image 
point Q = diag [1000.., 0.1], failed to result in a satisfacgemm 
design measure. All moves stayed in close proximity to the 
bgt jestsyil Sona This failure was apparently due to the relative 
insensitivity of the time to overshoot with respect to Q, 
which was exaggerated by the discrete time intervals used in 


the calculations. Fourteen iterations were performed in 4.6 


Minutes CPU time. 
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V. SUMMARY AND CONCLUSION 


Since the optimal state trajectory for a linear regulator 
System depends upon the weighting matrices chosen, it is de- 
Sirable to establish a relationship between the weighting 
matrix, Q, and the design objectives. 

Many authors have considered methods for selecting a 
weighting matrix for the infinite-final-time (ty =o) problem 
that result in a system that meets their requirements. The 
only methods surveyed that can be applied to the finite- 
final-time problem (t, < ©) are exhaustive search in Q space 
and trial-and-error adjustment of the Q matrix. 

The exhaustive-search method appears to be a feasible 
method for selecing Q under very restrictive conditions. The 
region that is investigated must be small or computation time 
borders on the ridiculous. This method 1s only feasible for 
systems where only two elements of the weighting matrix, Q, 
are allowed to vary. 

The estimation procedure does not require as many calcu- 
lations as the exhaustive method does for the same system, 
provided the subjective decisions are made properly and with 
efficient use of the computer. The procedure could be applied 
in situations where more than two elements of the weighting 
Matrix are allowed to vary, but the information that must be 


processed by the designer becomes excessive. 
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It has been shown that the sensitivity of the optimal 
state trajectory with respect to the weighting matrix can be 
evaluated using the influence function approach. Because 
this evaluation is computationally complex, and it is necessary 
to consider the time-varying trajectory 5 error to. seleet 
a change for the time-invariant weighting matrix, it was 
decided that this approach would not be fruitful. 

The procedure selected for development required the 
formulation of a vector design measure, m. This design 
measure was composed of generally used time-domain system 
characteristics such as percent overshoot, time to maximum 
overshoot, etc., and desired values were selected for each 
element of m. The purpose in selecting Q, therefore became 
the minimization of the absolute difference between each 

* 
element of m and its desired value ne Thisediff enencemin 
denoted by 
f.= jm sm | se ee ae oe (V-1) 


J 


om 
The sensitivity of the design measure, denoted by 39: 


S 


om 
must be approximated by finite-differences. == 1s related 


Q 
to the finite differential dQ by 


ag . 
Ci ya (V-2) 


This relationship was utilized to develop a procedure for 
selecting a dQ that results in the reduction of as many of 


the elements, — as possible. 
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The procedure for selecting dQ was incorporated in an 
iterative algorithm that attempts to select a weighting 
matrix Q that minimizes each design-measure difference, ce 

The algorithm was tested on three examples, two second- 
order systemsand one third-order system. These tests were 
carried out on the IBM 360-67 computer system operating in 
a time-sharing mode. Operation in this mode was mandatory 
due to the subjective decisions that are required by the 
procedure for selecting dQ. 

Computer CPU time for the third-order example was approxi- 
mately 91.3 minutes. It should be noted that this time in- 
cludes many calculations that were made solely to check out 
the algorithm. A designer who was reasonably familiar with 
this algorithm should require no more than one-third that 
time to develop an acceptable design for a third-order 
System. 

MMe wtests andieate what the procedure for selecting dQ 
is a valid extension of Equation (V-2), and does lead toa 
reduction in the elements a in a neighborhood of the Q in 
question. The test further indicates that the algorithm does 
lead to a minimization of the elements Se for a third-order 
system, if the number of elements, Bae used in the selection 


procedure for dQ is alternated in a judicious manner between 


one, two and three. Consideration must be given to the 
om. 

relative magnitudes of the various sensitivities, a . 
1 


1= 1, 2h ken, ) =, 2,-..,b,9and to the current values 


of m so that needless and useless computation is avoided. 
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The algorithm developed in Chapter III, modified by the 
consideration discussed above, appears to be a feasible pro- 
cedure for use in designing optimal controls for first-, 
second-, and third-order Pineanereou lag tomer An extension 
of the algorithm to linear tracking systems can be readily 
made. 

The extension of the algorithm to higher-order systems 
should be limited in feasibility only by the computer time 
required to integrate large-order systems of differential- 
equations. The selection procedure for dQ developed in 
Chapter III applies for a enact systems, provided that 
the number of design measure elements is less than or equal 
to n+l. This presupposes that the L hypersurfaces in n- 
dimensional Q-space, corresponding to the elements of m, 
have a common intersection. 

It is felt that further testing of the algorithm should 
be undertaken before incorporation in a general design pro- 
cedure. This testing should include higher-order systems and 
different combinations of design measures. 

A possible direction for future research concerns a time- 
varying weighting matrix, Q(t). A less time-consuming inte- 
gration scheme, such as on a hybrid analog-digital computer, 


could make the evaluation of the state-trajectory sensitivity, 


OX 

50’ feasible for higher-order systems. It seems reasonable to 
dx « e e 

assume 50 could be used to adjust the weighting matrix, Q(t), 


to reduce the absolute difference between the elements of the 


state vector and those of a desired state vector. 
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